A surrogate-assisted controller for expensive evolutionary reinforcement learning
نویسندگان
چکیده
The integration of Reinforcement Learning (RL) and Evolutionary Algorithms (EAs) aims at simultaneously exploiting the sample efficiency as well diversity robustness two paradigms. Recently, hybrid learning frameworks based on this principle have achieved great success in various challenging robot control tasks. However, these methods, policies from genetic population are evaluated via interactions with real environments, limiting their applicability computationally expensive problems. In work, we propose Surrogate-assisted Controller (SC), a novel efficient module that can be integrated into existing to alleviate computational burden EAs by partially replacing policy evaluation. key challenge applying is prevent optimization process being misled possible false minima introduced surrogate. To address issue, present strategies for SC workflow frameworks. Experiments six continuous tasks OpenAI Gym platform show not only significantly reduce cost fitness evaluations, but also boost performance original collaborative evolutionary processes.
منابع مشابه
A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems
Integrating data-driven surrogate models and simulation models of di erent accuracies (or delities) in a single algorithm to address computationally expensive global optimization problems has recently attracted considerable attention. However, handling discrepancies between simulation models with multiple delities in global optimization is a major challenge. To address it, the two major contrib...
متن کاملReinforcement Evolutionary Learning for Neuro-Fuzzy Controller Design
In recent years, the concept of the fuzzy logic or artificial neural networks for control problems has grown into a popular research area [1]-[3]. The reason is that classical control theory usually requires a mathematical model for designing controllers. The inaccuracy of mathematical modeling of plants usually degrades the performance of the controllers, especially for nonlinear and complex c...
متن کاملA fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance
Fuzzy logic systems are promising for efficient obstacle avoidance. However, it is difficult to maintain the correctness, consistency, and completeness of a fuzzy rule base constructed and tuned by a human expert. A reinforcement learning method is capable of learning the fuzzy rules automatically. However, it incurs a heavy learning phase and may result in an insufficiently learned rule base d...
متن کاملEvolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling
We present a parallel evolutionary optimization algorithm that leverages surrogate models for solving computationally expensive design problems with general constraints, on a limited computational budget. The essential backbone of our framework is an evolutionary algorithm coupled with a feasible sequential quadratic programming solver in the spirit of Lamarckian learning.We employ a trust-regi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information Sciences
سال: 2022
ISSN: ['0020-0255', '1872-6291']
DOI: https://doi.org/10.1016/j.ins.2022.10.134